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ABSTRACT 


The  purpose  of  this  thesis  is  to  derive  the  maximum  likelihood 
estimator  of  a  parameter  and  to  study  the  asymptotic  distribution  of  the 
estimator  based  on  the  assumption  that  the  sample  observations  are 
distributed  according  to  a  non-stationary  normal  Markov  process  when,  in 
fact,  the  true  multivariate  model  governing  the  distribution  of  the 
sample  observations  is  a  stationary  normal  Markov  process.  Daniels’s 
saddlepoint  approximation  method  using  the  method  of  steepest  descent 
is  reviewed  and  then  used  to  obtain  the  asymptotic  distribution  of  the 
estimator . 
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CHAPTER  I 


INTRODUCTION 

The  maximum  likelihood  method  of  estimating  a  parameter  is 
based  on  prior  knowledge  of  the  underlying  distribution.  The  estimator 
is  the  function  of  the  observed  sample  values  that  maximizes  the  joint 
density  function  of  the  sample  (or  the  joint  probability  function  for  a 
discrete  random  variable).  In  theory,  one  can  also  obtain  the  distribution 
of  the  estimator  from  the  assumed  joint  distribution  of  the  observations. 

If  the  assumption  of  the  underlying  distribution  is  invalid,  then 
inferences  based  on  the  derived  distribution  of  the  estimator  will  also 
be  invalid.  Such  considerations  are  important,  for  example,  in  studying 
the  power  of  hypothesis  tests  about  the  parameter. 

The  purpose  of  this  thesis  is  to  derive  the  maximum  likelihood 

A 

estimator  3  of  a  parameter  3  based  on  the  assumption  that  the  sample 
observations  are  distributed  according  to  a  non-stationary  normal  Markov 

A 

process  (Model  I)  and  then  to  study  the  asymptotic  distribution  of  3 
when,  in  fact,  the  true  multivariate  model  governing  the  distribution  of 
the  sample  observations  is  a  stationary  normal  Markov  process  (Model  II) . 

Model  I 

Suppose  we  have  a  sequence  of  random  variables  (X^ ,X^ , . . . ,X^} 

2 

such  that  Xq  is  normally  distributed  with  mean  a  and  variance  oq, 

and  X^Jx^  ^  is  normally  distributed  with  mean  a  +  3  X^_^  and 
2 

variance  a  for  k  =  l,2,...,n. 


1 


2 


Assume  the  normal  'scores’  are  Markovian,  that  is, 

f(xklXk-l,Xk-2,”*,Xo)  =  f(xklXk-l)  * 


Then 
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II 

i-h 

X 

•f  (x 

)  «  •  • 

,x  lx  ) 
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1 

n 1  o 

=  f  (x  ) 
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•f(x: 

IV 

•f(x  ,...,X  X  , x  ) 

Z  n  I  o 

=  f(x  ) 
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•f(Xl 

|x  ) 

1  o 

•f  (x  |x  , x  )  *f  (x  ,  . .  . , X 

Z  i  o  J  n 1 

=  £  (x) 
o 

•f  (Xj 

lXo> 

•f (x2 | x^ ) *f (x^, . . . ,x  |x  ) 

=  f(x  )*f(x  x  )*f(x  x  )  •••  f (x  x  ) 
o  l'o  2'1  n'n-l 


where  f (x  ,x^ , . . . ,x^)  is  the  joint  probability  density  function, 


We  have 


f  (x  )  =  - 

°  a  /zir 
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exp 


x  -  a 
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o 


and 


exp 


xk  - a  -  6xk-r 


therefore. 


1 

(1.1)  f (x  , — ,x)=  - 

o  n  nr~ 
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Next,  under  Model  I,  we  obtain  the  maximum  likelihood  estimator 

A 

3  for  the  parameter  3.  The  likelihood  function  is  defined  to  be  the 

joint  density  function  evaluated  at  x  ,x. , . . . ,x  ,  that  is, 

o  1  n 


L(a,3)  =  f (x  , . . . ,x  )  , 
o  n 


where  f(x  , ...,x  )  is  given  by  equation  (  1.1  ). 
So 


In  L(a,3) 


f 

x  -  a 
o 

Z 

1  n 

1  Y 

x .  -  a  -  3x .  , 

J  3-1 

r 

Q 

O 

2  ^ 
3=1 

r 

Q 

V. 

Then  the  partial  derivatives  with  respect  to  a  and  3  are: 


3 In  L  1  v  , 
a2/,(x 
3=1 


a  -  3x. 

1-1 
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3  In  L 

se 


i  n 

=  -2  I  (x  -  a  - 


3  =  1 


3x_._1)  (x  j) 


Setting  the  partial  derivatives  equal  to  zero  and  denoting  the  maximum 

A  A 

likelihood  estimates  of  a  and  3  by  a  and  3  respectively,  gives: 


n 


V  x .  =  na 

j-i  J 


A  A 


n 


+  »  I  Xj_x 

j=l  J 


n 


^  n 


n 


l  xixi_i  =  a  l  xi-i  +  @  l  xi.1 

3  =  1  J  3  j=l  3  3=1  J 


A  A 

To  solve  for  a  and  3  ,  multiply  the  above  equations  by  £  Xj-1  anc*  n 
respectively.  Subtracting  the  resulting  first  equation  from  the  second 


gives 


^  n  ?  *  n  „n  n  n 

"B  I  x,_,  -  6(  l  X  ,)  =  n  l  X  X  -  (  l  X  )(  l  x  )  . 

j=1  3  1  j=l  J  j=l  J  J  j  =  l  J  j=l  3 
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Thus 

(1.2) 


n 


n  n 


3  = 


n.I  x1xi.1  -  (  I  *p(  I 

3=1  J  J  1  3=1  J  3=1  J  1 


n 


n 


n  I  : 

j=l 


"  (J,x3-l> 

1=1  J 


n 


l*i  -  xu)(xj-i  -  V 

- 

J=1 


"  xz} 


where 


and 


Kl 


x 


u 


x  +  X-  +  .  .  .  +  X  - 

O  1_ n-1 

n 


x  +  x_  +  .  .  .  +  x 
1  Z  n 


n 


Solving  for  a  gives 


a  =  x  -  3  x- 
u  i 


Model  II 

Now  suppose  that,  in  fact,  (Xq ,X^ , . . . jX^}  obey  a  stationary 

linear  normal  Markov  process 

X.  =  8X.  .  +  e.  ,  i  =  0,1,..., n  ,  |b|  <  1, 

i  l-l  i  11 

where  (e^ , e^ , . . . , e^}  are  independent  and  identically  distributed 
standard  normal  random  variables.  (See  Daniels  (5),  p.  176.)  Note  that 
there  is  no  loss  in  generality  in  assuming  the  common  variance  a2  of 

A 

the  residuals  to  be  unity  since  3  is  unchanged  if  each  x^  is  replaced 

with  x^/a.  The  parameter  3  is  called  the  serial  correlation  coefficient. 


5 


The  condition  |$|  <  1  is  necessary  for  the  stationarity  of  the  process, 
a  result  that  will  be  shown  later.  Then  the  joint  probability  distribution 
of  {Xo>...,Xn}  is  given  by 


n+1 


(1.3)  dF (x  , . . . ,x  ) 

o  n 


2tt 


T exp  (- 


4-  x'C  ^x}  dx 
2 - —  o 


dx 


n 


where  C  is  the  variance-covariance  matrix  and  x'  =  (x  , . . . ,x  ). 
—  —on 


Early  work  on  the  problem  of  serial  correlation  was  done  by 
Yule  (17)  in  1921.  It  was  shown  by  both  Yule  and  Bartlett  (4)  that  the 
ordinary  tests  of  significance  become  invalid  if  successive  observations 
are  not  independent  of  one  another.  Wold's  (16)  pioneer  work  in  time 
series  analysis  also  created  interest  in  serial  correlation. 

However,  not  until  a  'circular'  definition  of  the  serial 
correlation  coefficient  was  suggested  by  Hotelling,  was  much  progress 
made.  R.  L.  Anderson  (3)  obtained  the  exact  distribution  of  r,  where 

-  2 

x.x.  +  ...  +  x  x,  -  ()  x.)  /  n 
1  2 _ n  1 _  1 

l  4  -  (I  V2/  n 

is  an  estimate  of  the  serial  correlation  coefficient.  Since  the  exact 
distributions  of  such  statistics  are  complicated,  simple  approximations 
were  sought.  Using  various  smoothing  techniques,  Koopmans  (9)  and 
Dixon  (6)  found  such  approximate  distributions  for  the  circular 
coefficient  with  known  mean,  the  equivalence  of  which  was  shown  by 
Rubin  (15) . 

Koopmans  (9)  considered  the  stochastic  process 

X±  =  6Xi_1  +  e.,  ,  i  =  1,2,. ..,n  ,  |b|  <  1, 


6 


where  3  is  the  serial  correlation  coefficient  and  the  {z^}  are 
independent  N(0,cr2)  random  variables.  For  testing  the  hypothesis  that 
3=0,  Koopmans  showed  that  it  is  sufficient  to  know  the  distribution  of 

n-l  _  _ 

I  (*!  -  x)  (x1+1  -  x) 

1  =  1 

n  _  O 

l  (*±  - 

i=l 


Dixon's  (6)  work  in  the  area  was  concerned  with  the  moments  of 


the  ratio 


n 


n 


2  (xi+i  -  XP 

i=l 


V 


n 


n 


-N  2 


l  (x.  -  x) 
i=l 


and  the  approximate  distribution  and  moments  of 


2  - 


n 


V 


n 


Anderson's  results  were  extended  by  Madow  (11)  to  the  circular 
case  where  3^0  and  an  exact  distribution  was  found. 

Madow' s  method  was  employed  by  Leipnik(IO)  to  deal  with  the 
case  of  the  circular  Markov  process.  An  approximate  distribution  was 
found  by  smoothing  the  joint  characteristic  function  of  the  numerator  and 
denominator  of  the  sample  correlation  coefficient;  that  is,  by  summing 
over  a  discrete  set  of  roots  using  an  approximating  integral. 

Until  Daniels's  (5)  work,  the  non-circular  cases  had  not  been 
dealt  with  to  any  great  extent.  For  both  circular  and  non-circular 
Markov  processes  with  known  and  unknown  means,  Daniels  used  the  method 
of  steepest  descents  to  obtain  the  approximate  distribution  of  the  sample 


serial  correlation  coefficient  r.  (The  method  is  discussed  by  Jeffreys 
and  Jeffreys  (7)).  His  estimate  of  3  in  the  non-circular  case  with 
known  mean  is 


7 


X1X2  + 


.  +  X  ,x 

n-1  n 


12  2 
"^1  +  X2  + 


2  12 

.  +  x  .  +  -rx 
n-1  2  n 


If  the  mean  is  unknown,  his  estimate  is 


c  -  (n-l)x2 
r  =  - - - - -  - 


(x^x)  (x2-x)  + 


.  +  (x  -x)  (x  -x) 
n— 1  n 


cq—  (n-l)x2  -jCx^ x)2  +  (x2-x)2  + 


.  +  (x  -x) 2  +  y(x  -x) 2 
n-i  Z  n 


Patton  (14)  also  considered  a  non-circular  Markov  process, 
both  with  known  and  unknown  means.  With  known  mean,  the  estimate  of  the 


serial  correlation  coefficient  was 

1  2  ,  ,  ,  1  2 
T  X,  +  X.X0  +  ...  +  X  -X  +  —  X 

c  21  12  n-ln2n 

r  c  2  2 

O  X,  +  .  .  .  +  X 


1 


n 


If  the  mean  is  unknown. 


r  = 


c  -  nx2  |(Vx)2+(xrx)(x2'x)+- 

-2 

c  -  nx 
o 


.  +  (x  i — x) (x  — x)  + — (x  -x)2 
n-1  n  2  n 


(x1-x)2+. 


.+(x  -x) 2 
n 


case 


Daniels  obtained  the  following  results  in  the  non-circular 
.  With  known  mean  the  approximate  distribution  of  the  estimate  r 


is 


h(r)  = 


n 


T (%n- 1 ) 


(i  3  )  d  a - (1  +  0(n  1}) 


2/tT  T(%n-%)  (l-3r)(l-23r+32)^n  1 


In  Leipnik’s  form,  where  the  approximation  has  remainder  that  is  relatively 
-1/2 

0 (n  ),  the  distribution  may  be  written  as 


with 


Mr)  -  ~^+1>  (1  +  0(n'3/2)) 

/tT  r(%N4^)  (l-23r+3  )2 


N  =  n  -  1  + 


1-6' 


Patton’s  results  are  summarized  below.  With  known  mean. 


h(r) 


-M^i! - (l-By(l-r2)^ -  (1  +  0(n-l}) 

2vV  r (hn-h)  (l-26r+3  )^n  (l-3r) (1-r) (1+3) 


or,  in  Leipnik's  form, 

,  ,  .  =  2  r  ftN+2) _ (l-r2)^(N+1^  ,  ,  -3/2.. 

^  r  r-  N+l  r  \  2  J-+I  ^  (n  )) 

vV  r(— )  (N(l+3)+2j  (l-r)(l-23r+3  )  2 

with 

N  =  n  -  1  + 

1-3 


If  the  mean  is  unknown, 


h(r)  = 


n  r'<ST') 


(l-r5’l(n"1) 


2 /iT  r (%n-l)  (1-B2)ls(l-Br)  (l-2Br+B2)!i<'n  ^ 


(1  +  0(n  b)  , 


or,  in  Leipnik’s  form, 


h(r)  =  - 


r(^) 


(l-r  ) 


2*%N 


(1  +  0 (n  3/2) 


/a  r(!jN+l)  ((l-B2)(N-l)+4)  (l-ZBr+B2)*5®  ^ 


with 


N  =  n  -  1  + 


3' 


1-3' 


In  Chapter  II,  we  derive  the  asymptotic  distribution  of  3 
following  the  methods  of  Daniels,  and  assuming  that  the  observations  are 
distributed  according  to  Model  II. 


CHAPTER  II 


THE  ASYMPTOTIC  DISTRIBUTION  OF  A  SERIAL 
CORRELATION  COEFFICIENT  OF  A  LINEAR  MARKOV  PROCESS 


2 . 1  Daniels's  Saddlepoint  Approximation  Method 

The  following  results  are  discussed  in  Daniels’s  (5)  paper  of 
1956.  We  wish  to  explore  the  distribution  of  statistics  of  the  form 


r 


9 


o 

where  c^  is  almost  surely  positive.  Let  c^,  c  have  the  joint  probability 
density  f(cQ,c).  To  find  the  distribution  of  r  we  use  the  transformation 
c  =  r  c  ,  c  =  c  .  The  Jacobian  of  such  a  transformation  is 


3  (cq,c) 
3(cQ,r) 


c 

o 


So  the  joint  probability  density  of  c^  and  r  is 


c  f  (c  ,  r  c  )  . 

o  o  o 

Then  the  probability  density  of  r  can  be  expressed  as  a  marginal  density 
by  integrating  out  c^,  giving 


(2.1.1)  h(r) 


f°° 

c  f(c  , 

o  o 

0J 


r  c  )  dc 
o  o 


Let  M(tQ,t)  =  E(exp  (tQCo  +  tc)) 


exp(t  c  +  tc)  f (c  ,c)  dc  dc 
o  o  o  o 


be  the  joint  moment-generating  function  of  c^  and  c.  Then  by  the 


9 


10 


Fourier  inversion  formula,  we  have 


f (cq,c) 


1 

(2iri)  2 


M(t  ,t)  exp f  -(t  c  +  tc)}  dt  dt 
o  k  o  o  J  o 


The  integration  is  along  the  imaginary  axes  of  tQ  and  t  (that  is,  in 

the  tQ  and  t  planes  from  +i°°  to  -i00)  ,  or  along  any  allowable 

deformation  of  these  paths.  In  other  words,  the  paths  of  integration  are 

along  any  paths  from  £-i°°  to  £+i°°  such  that  no  singularities  of  M(to>t) 

lie  on  the  new  paths  of  integration  or  between  them  and  the  imaginary  axes. 

Since  c  =  rc  , 

o 


(2.1.2) 


f (c  ,rc  ) 
o  o 


1 

(27Ti)2  f 


M(t  ,t)  exp f  -c  (t  +  rt))  dt  dt  . 
o  ^  oo  1  o 


Using  the  linear  transformation  u=tQ+rt  ,  t=t  ,with  the 
Jacobian 

3 (t  , t) 

- - -  =  1  , 

3 (u, t) 

equation  (2.1.2)  becomes 


f(c  ,rc  )  =  - 9 

O  O  /  n  •  \  ^ 

(2tti) 


M(u  -  rt,t)  exp(-Cou)  dudt 


'P'j^g  integration  of  u  is  taken  over  a  path  in  the  u  plane  corresponding 


to  that  of  t  in  the  t  -plane, 
o  o 


Then 

(2.1.3) 


0 


c  u 

f (c  ,rc  )  e  dc 
o  o  o 


0; 


(2iri) 


-c  u 

M(u  -  rt,t)  e  du  dt 


c  u 
o  , 
e  dc 
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2iri 


oo 

r 

* 

1 

2iri 

J 

.0 

h 

-c  u 

M(u  -  rt,t)  e  °  du 


c  u 

°  j 

e  dc 


dt 


The  usual  Fourier  inversion  formula  states 


PC° 


A(v)  = 


2tt 


or  equivalently, 

M(u  -  rt,t)  = 


A(w)  exp  f  i(w  -  v) c  )dwdc 

o'  o 


-c  u 

M(u  -  rt,t)  e  °  du 


r°° 

f 

i 

27ri 

j 

c  u 
o  , 
e  dc 

o 


Thus  from  equation  (2.1.3) 


o' 


3  c  u  1  r 

f (c  ,rc  )  e  °  dc  =  — r 
o  o  o  2tti 


M(u  -  rt , t)  dt 


When  differentiation  under  the  integral  sign  with  respect  to  u 
is  permissible,  we  obtain 


(2.1.4) 


3  c  u  ^ 

f (c  ,rc  )c  e  dc  =  — — r 
o  o  o  o  2tti 


9_ 

9u 


(m(u  -  rt,t)}dt 


Letting  u  =  0,  the  left-hand  side  of  equation  (2.1.4)  becomes  h(r) ,  so 
we  have 


h(r)  = 


27ri 


|^-  (m(u  -  rt ,  t) ) 


dt 


u=0 


It  is  often  desirable  to  transform  t  to  another  variable  z 
by  t  =  t ( z , u)  where  t(z,0)  maps  the  t-plane  onto  some  region  of  the 
z-plane.  Then 

r  ,  \  /  8t(z,u)  , 

M(u  -  rt , t)dt  =  M(u  -  rt (z,u) , t (z,u)J  — ^ -  dz  . 
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For  notational  ease,  we  write  this  as 


M(u  -  rt ,  t)  dz  . 

dZ 


Thus 


c  u 


o' 


f(c„,rcj  e  °  dc  =  -r~T 

o  2iti 


o  o 


M(u  -  rt , t)  ~  dz 
<3  z 


The  integration  is  now  along  the  transformed  contour  in  the  z-plane. 
Differentiating  once  again  with  respect  to  u  under  the  integral  sign 
and  letting  u  =  0  gives 


(2.1.5)  h(r)  = 


2iTi 


(M(u  "  rt,t)  ■—■) 


9u 


8z" 


This  equation  is  known  as  the  Cramer-Geary 


used  in  the  work  to  follow. 


dz 

u=0 

inversion  formula  and  will  be 


It  is  desirable  to  give  an  approximate  evaluation  of  integrals 

of  the  above  type  when  moderately  large  samples  are  used  to  calculate  the 

statistics  c  and  c  .  In  the  cases  considered  it  has  been  found  that 

o 

the  integrands  can  be  written  in  the  form  <j>  (z)  (z) ) n  where  n  is  the 

sample  size. 

The  method  of  steepest  descents  is  used.  (See  Jeffreys  and 

A 

Jeffreys  (7).)  Choose  a  contour  that  passes  through  a  saddlepoint  z 
at  which  ip' (z)  =0.  As  n  increases,  the  major  contribution  to  the 

A 

integral  comes  from  a  small  neighbourhood  around  z.  Now  the  integrand 

A 

is  expanded  about  z  and  term  by  term  integration  gives  an  asymptotic 
expansion  in  powers  of  (n  ) .  The  dominant  term  is  called  the 


saddlepoint  approximation. 


2.2  Linear  Markov  Processes 


Consider  a  subset  of  time  points  t,  <  t_  <  .  .  .  <  t  ,  and 

12  n 

the  random  variables  X(t.)  at  time  t..  The  joint  distribution  of 

3  3 

X(t^) ,  .  .  .  ,X(tn)  is  denoted  by  p(x(t^),  .  .  .  ,X(tn))  .  The  process 
is  called  completely  stationary  if 

p(x(t1),  .  .  .  ,x(tn))  =  pfxC^  -  t)  ,  .  .  .  ,x(tn  -  t)) 

for  all  subsets  t,  <  t_  <  .  .  .  <  t  and  all  t.  In  other  words,  the 

12  n 

joint  distribution  is  invariant  under  a  change  of  time  origin.  A  process 
is  stationary  of  order  k  if 

a1  a  a1  a 

E(X  (O-  •  -X  n(t  ))  =  E(X  (t.  -  x)*  •  -X  n(t  -  t)) 

n  l  n 

for  all  t  and  all  a,  +  .  .  .  +  a  <  k. 

1  n  — 

If  the  process  is  stationary  of  order  one, 

E (x(t) )  =  E(x(t  -  x)}  =  y  , 

that  is,  the  mean  is  independent  of  time.  If  the  process  is  stationary 
of  order  two, 

E(x2(t))  =  E (x2  ( t  -  t))  for  all  x,  and 
E(x(t1)X(t2))  =  E (x( t L  -  x)X(t2  -  t))  for  all  x. 

Then 

Var (X(t) )  =  E (x2(t) )  -  (E(X(t)))2 
=  Var (x(t  -  x)) 

=  a2  for  all  x, 

that  is,  variance  is  independent  of  time. 
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Also, 

Cov(x(t1),X(t2)}  =  E(x(t1)X(t2))  -  E(x(t1))E(x(t2)) 

=  Cov(x(t1  -  T>,X(t2  -  t)) 

=  C(t^  -  t p  for  all  t. 

-  t^)  is  called  the  autocovariance  and  is  independent  of  the  time 
origin.  Define  the  autocorrelation  function  by 


P  (x)  = 


C(t2  -  tx) 


where  t  =  -  t^  is  the  lag, 


Consider  a  linear  Markov  process  defined  by 

X.  =  3  X.  +  e.  . 

J  J-l  J 

If  we  assume  that  the  initial  state  is  X  ,  then 

o 

X.  =  gJX  +  eJ  e.  +  e0  +  .  .  .  +  e  e.  0  +  ge.  .  +  e. 

jo  1  2  j-2  j-1  j 


Since  E(e^)  = 


E(Xj  =  6:iXo  ->  0  as  j  -*  00  if  |$|  <  1  , 


that  is,  for  the  process  to  become  stationary  to  the  first  order,  it  is 


necessary  that  |g|  <  1. 
2 


E (ef)  =  Var (e . )  =  1  and  E(e.e.)  =  0  (i  ±  j),  we  have 
J  J  “ 


VarCXj)  =  E(X2)  -  (e(X^)) 


^J+  B2jX2 

.i  -  e2 

1  -  g2j 

2 

1  -  0 


-  (6jX  )2 
o 


Since 
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As  j  -*  00 


Var  (X .  )  ->  — - — - 

J  1-3 


if  3  <  1. 


For  any  fixed  t  >  0,  and  j  >  t. 


\ 


+  32j  TX2  -  (3jX  )(3j  TX  ) 
o  o  o 


1  -  B2(j T) 


As  j  +  °°, 

(2.2.1)  Cov (X . , X .  )  •+ — 2 — -  if  j  B I  <  1. 

J  1  -  e2 

Also,  for  any  fixed  x  <  0,  x  =  -  |x|  and 

Cov (X . ,X .  )  =  Cov(X . ,X .  ,  | ) 

J  J"T  J  J+|t| 


As  j  +  «, 

R  I  T  I 

(2.2.2)  Cov(X.,X._  )  — - j  if  |  3 1  <  1. 

J  J  T  1-3 

Therefore,  if  | 3 [  <  1 ,  the  process  approaches  stationarity  of  the  second 
order  as  time  advances  indefinitely.  Since  a  multivariate  normal  distri¬ 
bution  is  determined  by  its  first  two  moments,  a  normal  process  which  is 
stationary  to  the  second  order  is  completely  stationary.  In  subsequent 
sections  we  assume  that  the  process  has  reached  a  completely  stationary 


state . 
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2.3  The  Joint  Distribution  of  X  ,  .  .  .  ,X 

o  n 

Recall  Model  II:  If  X  ,  .  .  .  ,X  form  the  observed  sample 

o  n 

from  the  stationary  linear  Markov  process  then  they  have  a  joint  multi¬ 
variate  normal  distribution  since  e^,  .  .  .  ,e^  are  independent 
standard  normal  random  variables. 

Using  the  result  of  equations  (2.2.1)  and  (2.2.2) 


Cov (X . ,X .  )  = 

J  J-t 


3 


1-3" 


if  3  <  1  , 


the  variance-covariance  matrix  of  x'  =  (x  ,x, , . . . ,x  )  is 

—  o  1  n 


C  = 


1 


,n 


1-3" 


3 


2  2 

1-3  1-3 


3 


2  2 

1-3  1-3 


,n-l 


1-3' 


3 


n 


1-3 

n-1 


3 


1-3" 


1-3" 


Next,  evaluate  C  and  C 


-1 


C  = 


1-3" 


3 


n 


1-3' 


3 


2  2 

1-3  1-3 


1-3' 


3 


n-1 


1-3" 


3 


n 


1-3 

n-1 


3 


1-3' 


1-3" 


n+1 


Multiply  the  second  column  by  3 


and  subtract  from  the  first  column. 


C  = 


0 


0 


1-3 

0 


2 


0 


1-0' 

1 

1-0' 


,n-l 


1-0' 


0 


1-0' 

1 


1-0  1-0' 


sn_1  en'2 


1  —  0  1-0' 


0 


n 


1-0 

n-1 


0 


1-0' 


1-0' 


n+1 


0 


n-1 


1-0 

n-2 


0 


1-0' 


1-0' 


n 


Continuing  in  the  same  manner  gives 


|C|  = 


1-0' 

0 


0 


1-0' 

1 


1-0  1-0' 


1-0' 


(2.3.1) 
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To  find  C  \  recall  that  C  ^  =  (c  )  = 

“  ~  jk 


adj  C 


HI 


Obtain  adj  C,  in  the  same  manner  as  |cj .  By  the  symmetry  of  C, 


kj 

CJk  =  Ckj  f°r  j  ^  k*  Since  |cj  = 

follows  that  C_  is  the  (n*n)  matrix 


1-8 


2  >  by  equation  (2. 3.1), it 


-1 


1  -6 
■8  i+e: 

-3 


(0) 


-3 


1+3  -3 


(0) 


•3  1+3' 

-3 


-3 

1 


2 . 4  The  Asymptotic  Distribution  of  3 

For  Model  II  the  -joint  distribution  of  x  ,x, , . .  .  ,x  is 

o*  1  n 


dF(x  ,x  , . . . ,x  )  = 
o  1  n 


fl  ] 

n+1 

1 

f  \ 

-1  ,0-1 

.27h 

2 

,L  eXP 

c  * 

2  x  C  x 

dx  . . .dx 
o  n 


where  C  is  the  given  variance-covariance  matrix  and  x'  =  (x  ,x,,...,x  ) 
—  —  o  1  n 

*  ^  Q 

Writing  3  as  3  =  —  »  where  c  is  the  numerator  of  (  1.2  )  and  c 

c  o 

o 

is  the  denominator  of  (  1.2),  the  joint  moment  generating  function  of 


c  and  c  is 
o 
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M(t^,t)  =  E^expCt^c^  +  tc)} 


c  _  > 

o 

1/2 

r°°  /• 

(1-3; 

/  0  \ n+1 
(2tt) 

\  s 

—  oo* 

— cqJ 

exp(t  c  +  tc 
o  o 


tt  x'C  ^x)  dx  .  .  .dx 
2 - —  o  n 


Writing 

t  c  +  tc  -  7T  x’C  ^x  =  -  \  x'B  x  , 

where  15  is  the  appropriate  (n+l)x(n+l)  matrix,  gives 

1/2 

*  /• 

..  exp(  -  4-  x’B  x  )  dx  ...dx 
2 -  o  n 

I  I"1! 

Diagonalizing  15  with  the  transformation  having  the  Jacobian  |BJ 
gives 

(2.4.1)  M ( t  ,t)  = 

o 


(1-B2)  2 


B 


M(tQ,t)  = 


(l-B2) 


(2tt) 


n+1 


Next,  we  need  to  define  _B  and  evaluate  |Bj 


Recall,  from  (1.2), 


n 


n 


n 


"■It--1 

o 


n  l  xixi-i  ■  (  l  xi)(  l  xi_i) 
i=i  3  3  i=i  3  i=i  3 


n 


n 


l  x3-l  *  <  l  xj_J 
1=1  3  j  =  l  3 


Thus , 


(2.4.2) 


t  c  +  tc  -  4  x'C  ■''x 
o  o  2 - — 


n 

V  2 

r  n  > 

r 

2  r 

r  n  i 

p 

r  n  > 

=  t  n  2,  x.  -  t 

/  x-  i 

4-  tn  )  x.x.  _  -  t 

y  x . 

)  x .  . 

o  .  ,  i  —  1  o 

J=1 

•1  J-1 

1  =  1  J 

^ J  J 

j=i  J  j-1 

j=i J 

L  i-1 

U=1  J  J 

2(xo’X1- •  *  »xn^ 


1  -3 


-3  1+3  -3 


-3  1+3  -3 


(0) 


(0) 


•3  1+3  -3 

-3  1 


x 


x, 


X" 


n 


2  2  2 

-  2tn(x  x,+x.x„+. . ,+x  ,x  )  -  2t  n(x  +x,+...+x  .) 

o  1  12  n-1  n  o  o  1  n-1 


+  2t(x1+...+x  )(x  +...+X  .)  +  2t  (x  +x,+...+x  .) 

1  no  n-1  o  o  1  n-1 


2  2  2  2  2  2 
+  x  +  x  +  (1+3  ) (x  +x0+. . .+x  .) 

on  1  Z  n—  1 


-  23(x  X.+X.X.+...+X  _x  ,+x  ,x  ) 
o  1  12  n-2  n-1  n-1  n 


\  x'Jl  x  »  where  is  given  by 


B  = 


a 

c 

f 

f 

f 

f 

f 

i 

c 

b 

e 

d 

d 

d 

d 

i 

f 

e 

b 

e 

d 

d 

d 

i 

f 

d 

e 

b 

e 

d 

d 

i 

f 

• 

d 

d 

e 

b 

d 

d 

i 

• 

f 

d 

d 

d 

d 

b 

e 

i 

f 

d 

d 

d 

d 

e 

b 

g 

i 

i 

i 

i 

i 

i 

g 

1 

(n+1)  x  (n+1) 
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with:  a  =  1  -  2t  n  +  2t 

o  o 

2 

b  =  1  +  3  -  2t  n  +  2t  +2t 

o  o 

c  =  -3~tn+t  +  2t 

o 

d  =  2t  +  2t 
o 

e  =  -  3  -  tn  +  2t  +  2t 

o 

f  =  2t  +  t 
o 

g=-3-tn+t 
i  =  t 


To  evaluate  the  determinant  |B_|  ,  the  bordering  technique  of 
Aitken  (2)  and  Muir  (12)  will  be  used.  The  method  consists  of  adding 
another  row  and  column  to  the  matrix  without  altering  the  value  of  the 
determinant.  On  the  determinant 


B  = 


1 

0 

0 

0 

0 

0 


f  e 
f  d 
f  d 


1 

f 

e 

b 

e 

d 


1  1 

f  f 

d  d 

e  d 

b  e 

e  b 


1 

f 

•  d 

•  d 

•  d 

•  d 


1 

f 

d 

d 

d 

d 


_i 

d 

i 

i 

i 

i 

i 


0  f 
0  f 
0  i 


d  d 
d  d 
i  i 


d  d 
d  d 
i  i 


b  e  i 
e  b  g 
i  g  1 


perform  the  following  operations 
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(1)  Multiply  Row  1  by 

(2)  Multiply  Row  1  by 

(3)  Multiply  Row  1  by 


(-d)  and  add  to  Row 
(-i)  and  add  to  Row 
(-f)  and  add  to  Row 


k,  for  k  =  3,...,n+l; 
n+2 ; 

2. 


Thus  we  obtain 


1 

1 

1 

1 

1 

• 

• 

1 

1 

i 

-f 

d 

f2 

a~  d 

c-f 

0 

0 

0 

• 

• 

0 

0 

d 

if 

d” 

-d 

c-f 

b-d 

e-d 

0 

0 

• 

• 

0 

0 

0 

-d 

0 

e-d 

b-d 

e-d 

0 

• 

• 

0 

0 

0 

-d 

0 

0 

e-d 

b-d 

e-d 

• 

• 

0 

0 

0 

-d 

0 

0 

0 

e-d 

b-d 

• 

• 

0 

0 

0 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

-d 

• 

0 

• 

0 

• 

0 

• 

0 

• 

0 

• 

• 

•  • 

•  b-d 

• 

e-d 

• 

0 

-d 

0 

0 

0 

0 

0 

• 

• 

•  e-d 

b-d 

g-i 

-i 

if 

d" 

0 

0 

0 

0 

• 

• 

0 

g-i 

.2 

Now  let 

c-f=-(3+tn)=q  ,  and 

b-d=l+32~2tn=p  , 

o 

and  then  note  that 

e  -  d  =  -(3  +  tn)  =  q  , 

g-i=-(3+  tn)  =  q  »  and 


Then 


1  1  1 
0  0  0 


-d  q  p  q 


0  0 


1 

0 

0 


1 

0 

0 


i 


d 

0 


-d 


0  q  p  q  0 


0  0  0 


B  = 


-d 

-d 


0  0 


0 


0  0 


P 

q 


q 

p 


o  o 

o  o 


o 

o 


-d 


0  0  0  0  0 


p  q  o 


-d 

-i 


0 

.2 

i 


d 


0 

0 


0  0  0 
0  0  0 


q 

0 


The  row  totals  from  Column  2  to  Column  n+2  inclusive  are  found  to  be 

n  -  1  +  -7  +4"=n  , 

d  d 

f2  ‘2 

a  -  —  +  -7  +  q  =  q  +  l-2tn 

d  d  o’ 

p  +  2q 

p  +  2q  , 


P  +  2q 


y 


y 


+  q  =  q  +  1 


respectively 
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Multiplying  these  totals  by 


P  +  2q 


and  adding  to  column  1  gives 


B  = 


1  + 


dn 

p+2q 


+  d(q+l-2tnn) 
p+2q 


0 

0 

0 


0 

0 


.±  +  d_(q+ll 

p+2q 


!  i 


a-  d 


q 

o 

o 


p 

q 

o 


o 

o 


l  l 


q  o  o 


q 

p 

q 


o 

q 

p 


o  o 
o  o 


o 
o 
.2 

4  o  o  o 


l  l 

o  o 

o  o 
o  o 
0  0 


p 

q 

o 


q 

p 


o 

o 

o 


o 

q 


.2 

qi-i- 


The  column  totals  from  row  2  to  row  n+2  inclusively  are 


-  (i  +  f)  +  — |-r-(2 q  +  2  -  2t  n)  = 

P  +  2q  o  P  +  2q 


f2  .2 

q  +  a  —  —  +~  =  q  +  1  -  2 1  n 

d  d  o 


p  +  2q 


p  +  2q 


.2  2 
i  +  q  +  1  -  J  =  q  +  1 


respectively, 


-1 


Multiplying  these  totals  by  +-  and  adding  to  row  1  gives 


CL  |  H-  Qu  I  H* 
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where 


h  j  0  0  0  • 

f2 

la-—  q  0  0  • 


0  q 


p  q 


0  • 


0  q  p  q  • 

0  0  q  p  • 


0  0  0  0 

0  0  0  0 

.2 

m  -j  0  0 

a 


0  • 
0  • 
0  • 


h  =  1  +  -ia_  - 

p  +  2q  (p  +  2q)  2 
■  =  L  _  (q  +  1  ~  2tcn) 

d  p  +  2q 


0  0k 
.2 

0  0  ^ 

a 

0  0  0 

0  0  0 

0  0  0 

•  •  • 

•  •  • 

•  •  • 

p  q  o 

q  p  q 


=  i  _  (q  +  i) 

d  p  +  2q 


l 


m 


f  +  d(g  +  1  -  2tnn) 
p  +  2q 

d(q  +  1) 

p  +  2q 


_.2 

Multiplying  column  1  by  — 


and  adding  to  column  2  and  then  multiplying 


dk 


row  1  by 


and  adding  to  row  2  gives 
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l- 


.2, 

1  h 

dk 


J" 


.2. 

l  h 


9  9  dm  9 

f  i H  i,. 

a'  ~  '  ~  ‘  dk(J 


dm 


i2h 

dm 


) 


0  0  0 

q  0  0 


0  0k 
0  0  0 


0 

0 

0 


q 

0 

0 


p  q  0 

q  p  q 

0  q  p 


ooo 
ooo 
0  0  0 


0 

0 

m 


0 

0 

0 


ooo 

ooo 

ooo 


p  q  0 

q  p  q 

0  q  1- 


Letting 


s  =  J  - 


.2, 

i  h 

dm 


w 


=  l  - 


x  =  a  - 


i2h 

dk 

f2 

d 
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1  l 
dm 


2  2 

1  ,  .  _  1  frs. 

dkU  dm  ; 


.2 

i 


we  have 


h  s 
w  x 
0  q 
0  0 
0  0 
0  0 


0  0 

q  0 
p  q 
q  p 

0  q 

o  o 


o  o 
0  0 
0  0 

q  0 
p  q 
q  p 


o  0  k 
ooo 
ooo 
ooo 
ooo 
ooo 


0  0 

0  0 

m  0 


0  0 
0  0 
0  0 


0  0 
0  0 
0  0 


p  q  0 

q  p  q 

0  q  y 


(n+2)  x  (n+2) 


27 


Note  that 


m  = 


l  = 


w  = 


-  dk 

“  d3 

-  ds 


Expanding  |B|  along  the  first  column  gives 


(2.4.3)  |b|  =  h*Qn+1  "  w*Mn+1  +  (-l)n+1m-Nn+1 


where  Q  , ,  ,  M  , ,  ,  and  N  , .  are  defined  by 
n+1  n+1  n+1  J 


*n+l 


x 

q 

o 

o 


q 

p 

q 

o 


o  o 
q  o 

p  q 
q  p 


(0) 


(0) 


p  q 

q  p 

0  q 


o 

q 

y 


n+1 


M 


n+1 


s 

q 

o 

o 


o 

p 

q 

o 


o 

q 

p 

q 


(0) 


o 

o 

q 

p 


o 

o 

o 

o 


p 

q 

o 


o 

o 

o 

o 


k 

o 

o 

o 


q  o 
p  q 
q  y 


n+1 
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Expanding 


where 


N 


n+l 


s 

x 

q 

0 


0 

q 

p 

q 


o 

o 

q 

p 


(0) 


o 

o 

o 

q 


o 

o 

o 

o 


q 

p 

q 


o 

o 

o 

o 


o 

q 

p 


k 

o 

o 

o 


o 

o 

q 


n+l 


M  , .  and  N  , ,  along  the  elements  of  the  first  row  gives 
n+l  n+l 


M  =  s*X  +  (-l)n*k*qn  ,and 
n+l  n 


=  s*qn  +  (-l)n*k*Yn  respectively. 


X  = 
n 


P 

q 

0 


q  o 
p  q 
q  p 


(0) 


p 

q 

o 


(0) 


q 

p 

q 


o 

q 

y 


y  = 

n 


x 

q 

o 


q  o 

p  q 
q  p 


(0) 


(0) 


p  q 

q  p 

0  q 


o 

q 

p 


We  have  used  the  fact  that  the  determinant  of  a  triangular  matrix  is  the 
product  of  the  diagonal  entries. 

Therefore 


IH.1  =  hQn+i  “  W(sXn  +  +  (-l)n+1m(sqn  +  (-1)  ^Y^) 

=  hQn+1  -  swX^  -  kmY^  +  (-l)n+^(sm  +  kw)qn 

Note  also  that 

Q  =  xX  -  q2X  .  , 

n+1  n  n  n-1  * 

so 

(2.4.4)  |  B  |  =  h(xX  -  q2X  )  -  swX  -  kmY  +  (-1)  (sm  +  kw)qn 

n  n  n-1  n  n  n 

,  1  A 

=  (-1)  (sm  +  kw)qn  +  (hx  -  sw)X  -  kmY  -  q  hX  , 

n  n  n-1 

Next,  we  calculate  X  and  Y  . 

n  n 

2 

It  is  easily  seen  that  X^  =  y,  X^  =  py  -  q  ,  and  by  expanding  along 

the  first  row 

X  =  pX  .  -  q2X 
n  n-1  n-2 


Therefore 


(2.4.5)  Xn+2  -  pXn+1  +  q  Xn  =  0  . 


Define  the  operator  E  by  EX^  =  Then  we  maY  mite  equation  (2.4.5) 


ci  S 

(2.4.6)  (E2  -  pE  +  q2)Xn  =  0 


The  roots  of  this  equation  are 


u  = 


p  +  /p2-4q^ 

2 


and 


P  -  v/^4^ 

2 


where  u  +  v  =  p  and  u*v  -  q 


v 


Then  the  general  solution  of  equation  (2.4.6)  is 
(2.4.7)  Xn  =  Clun  +  c2vn 

Since  =  y  and  X^  =  py  -  t  we  have 

X1  =  clu  +  C2V  =  y  and 

2  2  2 

X2  ~  ciu  +  C2V  =  py  ~  q 

Solving  for  and  c gives 


=  y(p  -  v)  -  q' 

1  u(u  -  v) 


and 


_  y(u  ~  P)  +  q‘ 

v(u  -  v) 


Thus,  (2.4.7)  becomes 


(2.4.8)  X  = 
n 


fy(p  -  V)  ~  q2)  n  [y (u  -  p)  +  q2}  n 
u(u  -  v)  v (u  -  v) 


Comparing  X  with  Y  gives 
n  n 


(2.4.9)  Y  = 
n 


2  2 
(x(p  -  v)  -  q  )  n  (x(u  -  p)  +  q  )  n 

u(u  -  v)  v (u  -  v) 


Substituting  X^  and  Y^  into  [BJ  gives 


B|  =  (-l)n^"^(ms  +  kw)qn 


+  (hx  -  sw)  \  b(p.  -  )un  +  fy(u  -  p)  +  q  ) 

+  (hx  sw;  u(u  _  v)  u  v(u  -  V) 


-  km 


'fx(p  -  v)  ~  q  )  n  fx(u  -  p)  +  q  )  n 
u (u  -  v)  v(u  -  v) 


-  q2h 


’ fy(p  -  v)  -  q  )  n-i  fy(u  -  p)  +  q  )  n-1 
u(u  -  v)  U  v(u  -  v) 
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Now 

ms  +  kw  =  -2dks 

,  h(ad  -  f2)  +  l2 

hx  -  sw  =  - 7— = - -  , 

d 

thus 

(2.4.10)  |b|  =  (-l)n(2dks)qn 


h(ad  -  f2)  +  l2) 

fy(p  -  v)  -  q2)un  1  +  fy(u  -  p)  +  q2]vn  1 

l  d  J 

l  u  "  v  J 

+  dk 


2  f  fx(P  -  v)  ~  q  ]  un~l  +  [x(u  ~  p)  +  q  )vn-l 

u  -  V  u  -  V 


-  q2h 


fy(p  -  v)  -  q2)  ^n~2  +  fy(u  ~  p)  +  q^)irn-2 


u  -  v 


u  -  V 


Let  z  + 


Then  z  4-  1  =  ^ 


n 

and  z  +  z  +  1 

q 


=  0 


Thus  the  roots  are 


z 


+  /p^  -  4q^  _  -v 

q 


2q 


and 


1_  _  -  (p  +  /pz  -  4q 2)  _  -u 

z  2q  q 


Hence 

(2.4.11)  u  =  ,  v  =  -qz  ,  and  u  -  v  =  -^(1  -  z  )  . 

z 

Replacing  these  values  of  u  and  v  in  |bJ ,  we  obtain,  after  some 


simplification. 


32 


(2.4.12)  |_B|  =  (-l)n(2dks)qn 

n-2 


+ 


izal 


n-2 ( 1  2. 

z  (1  -  z  ) 


had  -  hf2  +  Z2 


(yp  +  yqz  -  q  ) 


2  2  2 
+  dk  (xp  +  xqz  -  q  )  +  hqz(yp  +  yqz  -  q  ) 


had  -  hf2  +  Z2 


f  i  2  \  2n-5 

(-yq  -  ypz  +  q  z)z 


+  dk  (-  xq  -  xpz  4-  q^z)z 


2n-5 


,  (  ,  2  .  2n-7 

+  hqz(-  yq  -  ypz  +  q  z)z 


Ignoring  the  terms  in  z2n  ^  and  z2n  ^ ,  since  these  give  only  an 
exponentially  small  error  in  the  final  approximation  (see  Patton  (14),  p 


we  obtain  the  approximate  result. 


(2.4.13)  |B 


=  (-l)n(2dks)qn 


Seal 


n-2 


n-2 ( .  2. 

z  (1  -  z  ) 


2  2 

had  -  hf  +  Z 


+  hqz 


(yp  +  yqz  -  q  ) 


2  2 
+  dk  (xp  +  xqz  -  q  ) 


.<C3l 


n-2 


n-2..  2. 

z  (1  -  z  ) 


2dkszn  2(1  -  z2)q2  +  dk2(xp  +  xqz  -  q2) 


+ 


o  o 

had  -  hf  +  ^ 


+  hqz 


(yp  +  yqz  -  q  ) 


Since,  as  we  shall  see  later  (p.39  ),  |z|  <  1,  except  in  exceptional 

cases  when  |z|  =  1,  the  first  term  is  exponentially  small  with  respect 
to  the  second  so  it  can  be  neglected. 


26), 
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Therefore 


(2.4.14)  I B |  * 


Izal 


n-2 


n-2,  2* 

z  (1  -  z  ) 


had  - 


2  2 
hf  +  l 

~A - —  +  h£lZ 


2 

(yp  +  yqz  -  q  ) 


2  2 
+  dk  (xp  +  xqz  -  q  ) 


Let  the  term  in  brackets  be  denoted  by  <J>  (z,u)  and  let  u  =  t  +  rt. 

J  n  o 

We  want  to  express  [ B [  in  terms  of  z  and  u. 


To  do  this,  we  need  to  simplify  cj>n(z,u).  It  will  suffice  to 

consider  <J>  (z,0),  that  is,  at  u  =  0,  since  we  will  be  evaluating 
n 


f“M(u  -  rt,t)  — 


at  u  =  0.  (See  the  discussion  on  p.  40.) 

Using  u  =  t  +  rt  and  z  H - =  we  find 

3  o  z  q 


(2.4.15)  _  q  =  Zd  +  B  -  2Br  -  2nu) 


1  -  2rz  +  z 


Let 


x  (1  +  3  -  23r  -  2nu) 

K(u)  =  — - 2 

1  -  2rz  +  z 


Then 


q  =  -  zK  , 


and  we  obtain  the  following  results 


t  = 


zK  -  3 


n 


t  = 
o 


nu  -  r(zK  -  3) 


n 
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a  =  1  -  2(n  -  1) 


u  - 


r(zK  -  3) 


n 


d  =  2 


u  +  (1  -  r) 


zK  -  0 


n 


f  =  2u  +  (1  -  2r) 


zK  -  3 


n 


l  = 


zK  -  3 


n 


Let 


A  =  zK(O)  -  3  =  Z(-X  +  g  ^ - ^..C1  +.  _z.  I 

1  -  2rz  +  z 


Then,  evaluating  the  above  quantities  at  u  =  0  gives 


a  (0)  =  1  +  2r 


n  - 

ll 

n 

\ 

y 

(zK  -  3)  =  (1  +  2rA) (1  + 


d(0)  » 


2(1  -  r)A 


n 


f(0)  = 


(1  -  2r)A 


n 


1(0) 


q(0)  =  -  (A  +  B) 


>  _  v  A 

t(0)  =  - 


,  _  N  -  rA 
t  (0)  =  — 

o  n 


0(n  h)  , 


Substituting  these  values  into  p(0),  h(0),  j (0) ,  and  0)  gives 

p (0)  =  1  +  32  +  2rA 
P(0)  +  2q (0)  =  (1  -  S)2  -  2A(1  -  r) 


h(0)  =  1  + 


2(1  -  r)A 


2(1  -  r) A(1  -  g*) 


(1  -  3)2  -  2A(1  -  r)  n((l  -  3)2  -  2A(1  -  r))2 


1  + 


2(1  -  r) A 


(1  -  B)  -  2A(1  -  r) 


(1  +  0 (n  l)) 


J  (0) 


(1  -  2r) 

2(1  -  r) 


(1  -  3)  -  A(1  -  2r) 

(1  -  g)2  -  2A(1  -  r) 


HO) 


2(1  -  r)A f (1  -  3)  -  A(1  -  2r ) }  _  A(1  -  2r)  =  0(n-l} 
n ( (1  -  3) 2  -  2A(1  -  r))  n 


Thus 


h(0)a(0)d(0)  = 


1  + 


2(1  -  r)A 


(1  -  3)  -  2A(1  -  r) 


(1  +  2rA) 


2(1  -  r) A 


n 


(1  +  0(n  b) 


h(0)f2(0)  = 


2(1  -  r)A 

2  2 

(1  -  2r)  A 

(1  -  6) 2  -  2A(1  -  r) j 

2 

n 

(1  +  0(n 


Z2(0)  =  0 (n  2) 


2  2 

Therefore,  since  h(0)f  (0)  and  l  (0)  are  small  compared  with 


h(0)a(0)d(0) ,  we  have 


h(0)a(0)d(0)  -  h(0) f 2(0)  4-  Z2( 0) 

d(0) 


1  + 


2(1  -  r)A 


(1  -  3)  -  2A(1  -  r)J 


(1  +  2rA)  (1  +  0 (n  X)) 


Now, 


q(0)h(0)z  =  -  (A  +  3) 


1  + 


2(1  -  r) A 


(1  -  3)  -  2A(1  -  r) J 


z  (1  4-  0  (n  ^)  ) 


Therefore , 

(2.4.16)  h(0)a(0)d(0)  -  h(0)f2(0)  +  l2 ( 0)  +  q(0)h(Q) 


1  + 


2(1  -  r) A 


(1  -  3)  -  2A(1  -  r)J 


(l  -  z3  -  A(z  -  2r)} (1  4-  0(n  ^)) 


To  find  y(0)p(0)  4-  y(0)q(0)z  -  q  (0),  observe  that 


y (0) p  (0)  = 


1  - 


2n(l  -  r). 


(1  +  32  +  2rA)  =  1  +  32  +2rA 


y  (0)  q  (0)  z  =  - 


1  2n(l  -  r) 


(A  +  3)z  -  -  (A  +  3)z 


q2(0)  =  (A  +  B)2 


Thus 


(2.4.17)  y (0)p (0)  +  y (0) q (0) z  -  q  (0) 


2n(l  -  r) 


(l  -  3z  +  32  +  A(2r  -  z))  -  (A  +  3)  . 


1 
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Thus  the  first  term  of  <J>^(z,0)  is  approximately  equal  to 


(2.4.18) 


1  + 


2(1  -  r)A 


(1  -  B)  -  2A(1  -  r) 


(l  -  z3  +  A(2r  -  z)) 


1  - 


2n(l  -  r) ^ 


(l  -  z3  +  32  +  A(2r  -z))  -  (A  +  3) 


where  the  relative  error  is  0(n  ^) . 


In  order  to  express  this  in  terms  of  3,  r  and  z,  we  need 
the  following  results: 


1  -  zB  +  A(2r  -  z)  =  U  -  Ez)(l  +  Bz  -  2rg) 

1  +  z  -  2rz 


t  r\  i  a 2  i  a  / o  \  1  -  2r3  +  8‘ 

1  -  z3  +  3  +  A(2r  -  z)  =  - » - 


1  +  z  -  2rz 


(1  -  3) 2  -  2A(1  -  r)  =  (1  ~  -Z'';  2~+  g  ■  --2-r^— 

1  +  z  -  2rz 


1  + 


2(1  -  r) A 


_  _  (1  -  3)^(1  +  z2  -  2rz) 

(1  -  3) 2  -  2A(1  -  r)  (1  -  z)2(l  +  32  -  2r3) 


Then, 


(2.4.19) 


1  + 


2(1  -  r) A 


(1  -  B)  -  2A(1  -  r)J 


(1 


z3  +  A(2r  -  z)) 


(1  -  3)2(1  ~  gz)(l  +  3z  -  2r3) 
(1  -  z) 2  ( 1  +  32  -  2r3) 


) 
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and 

(2.4.20) 


1  - 


2n(l  -  r) 


(l  -  8z  +  82  +  A(2r  -  z))  -  (A  +  8) 


=  (l  -  8z  +  82  +  A(2r  -  z))  -  (A  +  8)2  +  0(n  l) 


=  (1  +  3  ~  ~  gz>(l  +  8z  -  2rz)  ^  -1, 

~  +  0(n  ) 


(1  +  z^  -  2rz)^ 


By  equations  (2.4.19)  and  (2.4.20),  the  first  term  of  d>  (z,0) 

n 


(2.4.21) 


h(0)a(0)d(0)  -  h(0)f2(0)  +  l\ 0) 

d(0) 


+  q(0)h(0)z 


x  (y(0)p(0)  +  y (0) q (0) z  -  q2 (0) ) 


(1  -  8)2(1  -  8z)2(1  +  8z  -  2r8) (1  +  8z  -  2rz) 

2  2  2 
(1  -  z)  (1  +  z  -  2rz) 


(1  + 


Consider  now  the  second  term  of  ( z  ,  0)  ;  that  is. 


2  2 
dk  (xp  +  xpq  -  q  ) 


evaluated  at  u  =  0. 


We  have 


m(0)  = 


A  +  2(1 

n 


-  r)A(l  -  A  -  8) 


n ( (1  -  B)  -  2A(1  -  r)) 


(1  -  B)(2r  +  3  -  l)f  -z(l  +  B2)  +  8(1  +  z2)} 

n(l  -  z2)(l  -  2rB  +  B2) 


k(0)  - 


-  m(0) 
d  (0) 


0 (n  *))  . 


Therefore 


d(0)k2C0)  = 


=  (l-g)2(2r+e-l)2(l-2rz+z2)  fz(l+32)  -  g(l+z2)) 

2n(l-r) (1-z2) 2 (l-2r 3+g2) 2 


=  0 (n  l)  . 


Also 


x(0)  =  a(0) 


f2(0)  2i2(0)Z2(0)  i4(0)h(0) 
d(0)  d (0)m(0)  d (O)m^ (0) 


=  1  + 


2rA  - 


(l-2r)2 

4(l-r)2 


A  2(l-r) f(l-B)-A(l-2r)}  -  (l-2r) f (1-B) 2-2A( 1-r)) 
(1-r)  (l-B)^  -  2 (1-r) (1-6) 

x  (1  +  0  (n_1)  ) 


Since 

p(0)  =  1  +  g2  +  2rA  and 

q (0)  =  -  (A  +  g) 


x ( 0 ) p ( 0 )  +  x (0)p (0) q (0)  -  q2 (0)  will  be  of  the  same  order  as  x(0). 
Now, 

d(0)k2(0)  =  0(n_1) 


so 

(2.4.22)  d(0)k2(0) (x(0)p(0)  +  x(0)p(0)q(0)  -  q2(0>)  =  0(n_1) 


and  is  therefore  small  compared  with  the  first  term  of  (j)^(z,0). 
Thus 


(2.4.23)  4>n(z,0) 


q-B)2a-Bz)2a+Bz-2rB)(l+gz-2rz)  ,,  Q(  -1„ 

9  2  2  v  v 

(1-z)  (1+z  -2rz) 
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Recall  from  equations  (2.4.14)  and  (2.4.15)  that 


B  = 


(-q)n  24>n(z,u) 

n-2,  2n 
z  (1-z  ) 


(l-2rg+g2-2nu)n  2 


(l-z2)(l-2rz+z2)n~2  Tn 


<$>  (z,u) 


and 


3  +  tn  =  z(1~2rg+g  -2nu) 
l-2rz+z2 


Then 


t  =  z(l-2rB+3  -2nu)  _  _g 


n(l-2rz+z  ) 


n 


so  that 


(2.4.24)  11 

9z 


(l-2rg+g2-2nu) (1-z2) 

n(l-2rz+z2) 2 


The  joint  moment  generating  function  M(tQ,t)  was  given  by  (2.4.1), 


2.  ^ 


M(t  ,t)  = 
o 


(1-3  ) 


B 


Substituting  for  |BJ  and  writing  t  as  u  -  rt  gives 


2.%,.  2, u 


n-2 

2,  2 


M(u  -  rt,t)  = 


9 1 


(1-g  )  (1-z  )  (l-2rz+z  ) 

n-2 

(l-2rg+g2-2nu)  2  I  <j>  (z,u)'  2 

1  n 


Multiplying  this  by  —  and  combining  terms  gives 


n 


.2,1*,,  2,2 


2,2 


-3 


M(u  -  rt,t) 


9 t  =  (1-g  )  (1-z  )  (l-2rz+z  ) 

9  z  _n_2 

n(l-2rg+g2-2nu)  2  |  4>^(ztu) 


The  contribution  of  the  partial  derivative  of  <}>^(z,u)  with  respect 
to  u  is  so  small  compared  with  the  partial  derivative  of 
(l-2rg+g2-2nu)^n_2  that  we  can  evaluate  <J>n(z,u)  at  u  =  0  prior 


to  taking  the  partial  derivatives. 
Thus , 


(2.4.25) 


9u 


M(u  -  rt,t) 


9_t 

9z 


u=0 


=  (^-32)^(1~z2)2  (l-2rz+z2)2  (n-4) 

(l-2rB+32)2  U  (z ,  0) 1 ^ 

n 


Next,  substitute  the  value  of  <f>n(z,0)  into  equation  (2.4.25),  giving. 


(2.4.26)  JL- 
9u 


M(u  -  rt ,  t)  -p 

a  Z 


u=0 


n 


n(l-z) (1-z2) 2  (l-e2)^(l-2rz+z2)2 

(1-3)  (l-3z)  (l+3z-2r3)^|  l+3z-2rz  r^(l-2r3+32)  2 


(1  +  0 (n  X)) 


Note  that  in  equation  (2.4.26),  the  factor  (n-4)  has  been  replaced  by 
n  since  n-4  =  n(l  +  0(n  ^)). 

Recall  from  equation  (2.1.5  )  that  the  probability  density 
function  of  r,  h(r) ,  can  be  written  as 


h(r)  = 


2tt± 


f 

'v 

9_ 

9u 

M(u  - 

x 

rt>t) 

J 

u=0 


dz 


where  the  integration  is  performed  along  the  transformed  contour  in  the 
z-plane . 

The  integrand  may  be  written  in  the  form  0 (z) (z) ) n  so  that 


2,h 


(2.4.27)  h(r)  “ 


n(l-3  ) 


iLi 

27Ti(l-3)(l-2r3+32)2 


— _2 

0 (z) (l-2rz+z2) 2 
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where  3 

2  2 

(2.4.28)  0  (z)  =  - a_-_z)(l-z  _) _ _ 

(l-0z)  (l+Bz-2rB)  ^  |l+gz-2rz 


The  transformation  from  the  t-plane  to  the  z-plane  defined 


—  =  +  +  2rtn 

z  3  +  tn 


can  be  expressed  as  a  series  of  elementary  mappings.  Note  that 


(2.4.29) 


—  =  1  3  -  2rg  +  2rg  +  2rtn 

z  3  +  tn 


1  +  32  -  2rg 

3  +  tn 


+  2r 


Then  the  elementary  mappings  are: 


A:  V  =  3  +  tn 


1  +  32  -  2r3 


D:  Q  =  S  +  r 

E:  z  +  -  =  2Q 

z 


E  maps  the  Q-plane  cut  along  the  real  axis  from  -1  to  1  to  the 
interior  of  the  unit  circle  in  the  z-plane.  The  other  mappings  change 
the  endpoints  of  the  cut  on  the  real  axis.  So  the  transformation  maps 
the  whole  t-plane  cut  along  the  real  axis  exterior  to 

{  2  2 

-(1  +  3)  (1  -  3) 

2n(l  +  r)  ’  2n(l  -  r) 

l 

onto  the  interior  of  the  unit  circle. 


43 


The  endpoints  of  the  path  of  integration  in  the  z-plane  are  found  as 
follows . 


As 


then 


t  ±i°°  ,  z  +  — 

z 


=  1  +  3  -  2rB 

u=0  3  +  tn 


+  2r  ->  2r  ; 


1  2 

z  H - -  2r  or  z  -  2rz  +1  =  0 

z 


Thus , 


z  = 


2r  ±  /4r2-  4 


=  r  ±  /r 2  -  1  =  r  ±  i/l  -  r2 


=  e 


±i0 


where  r  =  cos  0 


If  t  =  0,  by  equation  (2.4.29), 


2  +  7  ’  *  -+  Be  ~  2rP  +  2r  '  6  +  |  • 


Therefore,  in  the  z-plane,  the  path  cuts  the  real  axis  at  z  =  3.  So 

the  path  of  integration  crosses  the  real  axis  at  z  =  3  and  ends  on  the 

“~i0  i0 

boundary  of  the  unit  circle  at  e  and  e 


Upon  inspection  of  the  integrand  of  h(r),  we  find  that  the 
only  possible  singularities  between  r  and  3  would  occur  if 

1  +  3z  -  2r3  =0  or  1  +  Sz  -  2rz  =  0. 

Consider  the  first  case,  that  is,  1  +  3z  -  2r3  =  0. 

(i)  r  <_  z  <_  3,  r  <  3 

If  3  >  0, 

1  +  3z  -  2r3  >  1  +  3r  -  23r  =  1  -  3r  >  0. 
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If  3  <  0, 

1  +  Bz  -  2rB  >_  1  +  32  -  2r3  =  1  -  2r3  +  B2  +  r2  -  r2 

=  (6  -  r)2  +  (1  -  r2)  >  0. 


(ii)  B£z£r,  3  <  r 

If  3  >  0, 

1  +  3z  -  2r3  >_  1  +  32  -  2r3  =  (3  -  r)2  +  (1  -  r2)  >  0. 

If  3  <  0, 

1  +  3z  -  2r3  >_  1  +  3r  -  23r  =  1  -  3r  >  0. 


(iii)  3  =  z  =  r 

1  +  32  -  2r3  =  1  +  3r  -  2r3  =  1  -  3r  >  0. 


Thus,  no  singularities  arise  from  the  term  (1  +  3z  -  2r3)  for  z 
between  r  and  3* 

Now  consider  the  second  case,  that  is,  1  +  Bz  -  2rz  =  0.  Solving  for  z 
gives 

Z  =  2r  -  3 


thus  a  singularity  occurs  between  r  and 


if  z  = 


In  order 


2r  -  3  * 

to  deform  the  path  of  integration  we  must  restrict  the  range  of  values 


that  r  may  take  for  a  given  3. 

For  values  of  z  between  r  and  3,  1  +  Bz  -  2rz  will  be  non-zero  in 

each  of  the  following  regions: 


2r  -  3 


>  3  or 


2r  -  3 


<  r  if  r  <  3 


2r  -  3 


<  3  or 


2r  -  3 


>  r 


if  r  >  3 


* 
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Consider  each  of  these  regions  individually. 


(i)  r  <  6, 


2r  -  3 


>  3 


If  3  >  0,  %3  <  r  <  3  . 

If  3  <  0,  no  values  of  r  fall  in  the  region, 


(ii)  r  <  3, 


2r  -  3 


<  r 


t -P  a  r\  3  _  ^3Z  +  8  ,  _ 

If  3  >  0,  - - -  <  r  <  ^3  . 


If  3  <  0,  ff  +  8  <  r  <  3  . 


(iii)  r  >  3, 


2r  -  3 


<  3 


If  3  >  0,  no  values  of  r  fall  in  the  region, 
If  3  <  0,  3<r<%3. 


(iv)  r  >  3, 
If  3  >  0,  3  <  r  < 


1 


2r  -  3 
3  +  /32  +  8 


>  r 


If  3  <  0,  Jg3  <  r  < 


3  +  /32  +  8 


Combining  these  results  gives  the  allowable  range  of  values  for  r,  that 
is, 

e  -  /ez  +  8  8  +  /gz  +  8 

- - - <r< - - 

Note  that  for  z  lying  between  r  and  3  ,  and  r  falling  in  the 

above  range,  1  +  3z  -  2rz  >  0. 
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Thus,  for  r  in  the  region 


6  -  h'2-  +  8  3  +  /b2  +  8 


,  the  path  of 


4  ’  4 

integration  in  the  z-plane  may  be  deformed  to  be  the  straight  line 
~i0  i0 

joining  e  to  e  (r  =  cos  0  )  and  crossing  the  real  axis  at 


z  =  r.  Thus  the  deformed  path  is  the  straight  line  joining  r  -  i/l  -  r 2 


and  r  +  i/l  -  rz  and  so  may  be  written  as 


(2.4.30)  z  =  r  +  iw/l  -  rz  where  -1  <  w  <  1. 


Recall  from  equations  (2.4.27)  and  (2.4.28)  that 


2, 


(2.4.31)  h(r)  = 


n(l-3  ) 


*_1 

27Ti(l-B)(l-2r3+32)2 


n 


_2 

0(z) (l-2rz+z2)2  (1  +  0 (n_1) ) 


where 


0(z)  = 


2  2 

(1-z) (1-z  ) 


(l-3z) (l+3z-2r3)  2| l+3z-2rz 


In  terms  of  r  and  w. 


and 


1  -  2rz  +  z2  =  (1  -  r2)(l  -  w2) 


dz  =  i/l  -  rz  dw 


Substituting  into  equation  (2.4.31)  gives 

n-3  1 

h(r)  -  °(l-B2)li(l-r2)  2 


— -1 

2Tr(l-B)(l-2rS+B2)2 


n 


0(z)  (1-w2)2  dw  (1  +  0(n  S) 


-1 


Expand  0(z)  as  a  power  series  in  (z  -  r)  using  equation  (2.4.30) 
0(z)  =  0(r)  +  0T(r)(z  -  r)  +  ...  +  - - — - 1-  ... 

K.  • 

_k 

=  9  (r)  +  i»/T?8'(t)  +  ...  +lJLi^V9«(r)  + 

K.  • 

Thus , 


(2.4.32)  h(r)  = 


n(l-g2)"2(l-r2)  2 

*_1 

2tt ( 1— 3 )  (l-2r3+g2)2 


1 


00  .k,  2.2 

x  l  1  -  e(k)(r) 


k=0 


k! 


— _2 

k  ?  2 
w  (1-w  )  dw 


-1 


where  the  relative  error  is  0(n  ). 

--2 

k  2  2 

For  k  =  2m  +  1,  m  =  0,1,2,...  ,  w  (1-w  )  is  an  odd  function  so 


the  integral  vanishes,  giving 
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n-3 

2^h,,  2.  2 


(2.4.33)  h(r)  =  — g  ^  (1  r  ) 


n 


2Tr(l-B)(l-2rB+B2)2 


x  V  (-l)k(l-r2)k  e(2k) 

Jo  <2k>:  (rJ 

X  (1  +  0(n_1)) 


2k,,  2, 

w  (1-w  )  aw 


Let 


(2.4.34)  T  = 
k 


n 


n 


2kn  2.2  ,  _ 

w  (1-w  )  aw  =  2 


2k.  2.2 

w  (1-w  )  aw 


-1 


0 


and  let  v  =  w  ,  so  that 


dv  =  2wdw  and  dw  =  %v  dv 


Then 


1  n. 

f  k-h,.  .2  Z 

v  (1-v)  dv 


Compare  I  to  the  Beta  function  given  by 


B (m,n) 


1 


m- 1  . ..  . n- 1 

x  (1-x) 


0 


r  (m)r  (n) 
T (m+n) 


Then 


'  v(k+!s)-l(1_v)ftn-l)-l 

0 


=  B(k  +  j;  f  -  1) 


dv 


holp 
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r(k  +  i)r(|  -  l) 

r(k  +  f  -|> 


Evaluate  I,  for  the  first  few  values  of  k  using  the  results 


T  (k  +  1 )  =  kf  (k)  and  T  (-j)  =  /rT 


We  obtain. 


for  k  =  0, 


I  = 
o 


r(|)r(S  -  l) 

r(^) 


vV  r(|  -  l) 

r(^) 


k  =  1 


I,  = 


r  (f  > r  (f  ■  L) 

r(-2±i) 


n-l  o 


k  -  2,  I,  = 


r(|)r(|  -  i) 
v(^r) 


1*3 


(n-l)  (n+1)  o 


In  general,  for  k  =  1,2,... 


(2.4.35)  I  =  - - 1-3  •••  (2k-l) 


k  (n-l) (n+1)  •••  (n+2k-3)  o 


where 


I  = 
o 


&  r(|  -  l) 

r^) 


Using  equation  (2.4.34),  equation  (2.4.33)  becomes 


n(l-B2)!l(l-r2)  2 


,fl  k^O  (2k): 

2ir(l-B) (l-2rg+8  )- 


X  (1  +  0(n  b) 


h(r)  = 
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Substituting  for  I  using  equation  (2.4.35)  gives 

h(r)  -  _n(l-B2)ii(l-r2)~r 

n_  ^  o 

2it(1-B)  (l-2rB+B2)2 


6(r)  +  9(2k)^ 

lc  1 


1-3 


(n-l)  (n+1) 


or , 


X  (1  +  0(n  b) 


n-3 


n  „2^,,  2,  2 


(2.4.36)  h(r)  = 


n  r(-|-l)  (1-3  )  (1-r  j 

_ 

lA  f  (^b  (l-B)  (l-2rB+B2)  2 


00  ,  .  >.  k  2.  k  (2k)  ,  . 

0 (r)  +  l  -J-.1-)  (I-*.  >  6 - M 

k=l  2kk! ((n-1)*** (n+2k-3)) 


(1  +  0  (n 


-1 


Replacing  z  by  r  in  equation  (2.4.28)  gives 


0(r)  = 


2  2 

(1-r)  (1-r  )Z 


2^2 


-  (1  +  0(n  X» 


(1-Sr) (l+Sr-2r3) 2(l+3r-2r  ) 


(l-r),(l-,r2)2  (1  +  0(n-1) ) 


2, 


(l-3r)  (l+3r-2r  ) 


Thus,  a  first  approximation  to  h(r)  is 

1 


n-3 


n  r(|-l)(l-02)2(l-r2)  2  (1-r) (1-r2) 2 

_  j  y 

2 A  r(-2|i-)(l-B)(l-2r8+B2)2  (1-Br)  2(l+Br-2r2)2 


X  (1  +  0(n  b) 


(2k-l) 

• • (n+2k-3) 


h(r)  = 
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1 


n 


(2.4.37) 


n  r(^l)(l-B2)2(l-r)(l-r2) 


2.  2 


(1  +  0 (n  l))  , 


3 


1 


2/?r  r  (^)  (1-3)  (l-3r)  2  (l+3r-2r2)  2  (l-23r+32)  2 


where 


3  -  +  8 

4 


<  r  < 


3  +  /32  +  8 

4 


CONCLUSION 

In  order  to  extend  this  result  to  all  values  of  r  between  -1 
and  1  it  would  be  necessary  to  examine  the  behavior  of  the  density  at 


the  singularity  z 


—  .  The  path  of  integration  can  not  be 

p 


deformed  through  this  singularity  so  an  alternative  approach  must  be  used. 
It  can  be  shown  that  this  singularity  is  a  branch  point  and  thus  can  be 
treated  using  techniques  from  complex  analysis.  The  method  would  consist 
of  choosing  an  appropriate  contour  around  the  branch  point  and  adding  up 
the  contributions  from  each  portion  of  the  integral. 

Note  however  that  the  major  part  of  the  probability  lies  within  the 
allowable  range  of  values  for  r  .  In  fact  at  r  =  3  the  probability  is 
large  and  decreases  rapidly  on  either  side  of  3  .  As  n  increases, 
the  peak  becomes  sharper  and  the  tail  probabilities  decrease. 
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